Apparatus and method for measuring anatomical objects using coordinated fluoroscopy

ABSTRACT

Two fluoroscopic images taken from two different angles of the same anatomical feature are registered to a common three-dimensional coordinate system. A dimension of the anatomical feature is determined by specifying with reference to the two registered fluoroscopic images two constrained points within the three-dimensional coordinate system that correspond to the boundaries of the anatomical feature, and calculating a straight-line distance between the two. Additionally, a three-dimensional virtual model of an implant is projected into each of two, registered fluoroscopic image, and a surgeon manipulates the projections to adjust the size and shape of the virtual model, and thereby determine parameters for the implant.

This patent application is a divisional of U.S. patent application Ser.No. 09/484,809, entitled “Apparatus and Method for Measuring AnatomicalObjects Using Coordinated Fluoroscopy,” filed Jan. 18, 2000 nowabandoned.

FIELD OF THE INVENTION

The present invention relates to an apparatus and method for measuringanatomical objects in the body and/or to sizing surgical implant ordevices.

BACKGROUND OF THE INVENTION

Measuring anatomical features might be expected to be done on athree-dimensional data set, such as can be reconstructed from data takenduring a computed tomography (CT) scan or a magnetic resonance image(MRI) scan. However, equipment for CT and MRI scans are expensive andbulky. Furthermore, they may not be available when and where needed. Forexample, CT and MRI equipment is usually not available for use during amedical intervention procedure, or within an operating room or treatmentarea.

Where knowledge of the anatomical feature is very important, a CT or MRIscan might be taken in advance of the procedure and the procedureplanned based on it. However, there are many more medical procedures andinterventions that might benefit from knowledge of the size of ananatomical feature in the patient, where the cost a CT scan is notjustified or CT equipment is not available. For example, to treat atumor or aneurysm, it is often helpful to know the size of the tumor orocclusion. Similarly, it would be helpful to know in advance of surgicalinterventions that involve implanting stents, screws, nails, or otherdevices in the body how well a chosen device will fit, or if a device ofa different size or shape would be more appropriate.

SUMMARY OF THE INVENTION

Unlike CT and MRI scans, fluoroscopic images are easily acquired and, ascompared to CT and MRI scans, relatively inexpensive. The equipment canbe located, if necessary, in a surgery or treatment room, and can beused during course of an intervention if necessary. A physician orsurgeon also has control over the positioning of the fluoroscoperelative to the patient, thereby allowing the doctor to take the imagesthe doctor prefers. With an accurate knowledge of an anatomicaldimension, the chance for success of a medical or surgical procedurewill often be improved. For example, determining accurately ananatomical dimension with a fluoroscope can assist with the selection ofthe correct size of implantable device, or with the preparation of acustom-made device, without having to use CT or MRI scans.

In accordance with one objective, one embodiment of the inventiondetermines the distance between two or more anatomical landmarks. Atleast a first and a second fluoroscopic image are taken fromdifferent—though not necessarily orthogonal—angles of the same portionof a patient's body. These images are registered using a computer to acommon three-dimensional coordinate system of the workspace or patient.A user specifies to the computer at least two points within the firstfluoroscopic image corresponding to anatomical landmarks within thefirst image that are identified by the user. Each of the two pointsspecified in the first image defines, in accordance with a predeterminedgeometric model of the fluoroscope, an imaginary “line of sight” in thethree-dimensional coordinate system that can be indicated on the secondimage. The user indicates to the computer, with reference to the secondimage, where along each imaginary line of sight the correspondinganatomical landmark lies. Additional points in the three-dimensionalcoordinate system that correspond to other anatomical landmarks may alsobe specified by the user should the user be interested in determining alength of a curved line passing through (or near to) them. The computerthen determines, based on the positions within the three-dimensionalcoordinate system of the specified points, the length of the linespecified by them. In the case of two points, this length would be thestraight line and thus represent the shortest distance between the twopoints. Using two points would be useful for finding a dimension of ananatomical object, for example the diameter of a blood vessel. If thecase of three or more points being specified, this length would be ofthe line, straight or curved, passing through the points. For example,finding the length of a curved object, such as a portion of a bloodvessel, could be reasonably accurately determined by specifying aplurality of points that indicated approximately the centerline of theobject. The length of a contour of an anatomical object could bedetermined in a similar manner.

In accordance with another object, the rate of velocity and the rate ofacceleration of an object within the body is determined by identifyingthe position of the object in successive, fluoroscopic images registeredto a common frame, taken at known time intervals. For example, a leadingedge or crest of a boundary of radio-opaque dye injected into a bloodvessel is used as a marker to determine volumetric blood flow rate.

In accordance with another objective, another aspect of the preferredembodiment of the invention includes a definition of a three-dimensional“virtual surgical object.” The virtual surgical object has one or moreattributes corresponding to one more physical characteristics of asurgical object to be implanted in the patient, for example the shapeand size of the outer surface of the surgical object. The computerdisplays a two-dimensional graphical representation of this virtualsurgical object, referred to as a “projected surgical object,” on eachof two or more fluoroscopic images registered to a common,three-dimensional coordinate system. A user identifies at least aninitial location for the virtual surgical object within the patient,such as by identifying a point in one of the images at which itsprojected surgical object is to be drawn in that image. Once an initialposition of the virtual surgical object is defined, the computer thendraws corresponding projected surgical objects in all of the images.Because each projected surgical object is constrained to correspondgeometrically to the same virtual surgical object in three-dimensionalspace, manipulation through a user input of a projected surgical objectwill cause a change in positioning, size and/or orientation in thevirtual surgical object, and thus result in the computer redrawing theprojected surgical object(s) in the other image(s) to correspond to thechange. The user is thereby able to manipulate the virtual surgicalobject and determine its fit with the anatomy of the patient based onthe alignment of the projected surgical objects with the anatomicalfeature shown in each of the images. If necessary, the user can try adifferent predefined virtual surgical object, or resize or reshape thevirtual surgical object by altering one or more attributes of thevirtual surgical object. The user may alter the attributes throughrevising the definition of the virtual surgical object and/or throughmanipulation of one or more of the graphical representation constitutingthe projected surgical objects. Once the appropriate size and/or shapeof the virtual surgical object is determined, the information can beused to select the most appropriate prefabricated implantable surgicalobject, to custom make an implantable surgical object, to determine thefatigue (e.g., maximum stresses and strains) life of the implantablesurgical object, to determine whether an implantable surgical objectwill not function properly once implanted (e.g., the kinking of a stentgraft in torturous vessel), or to customize an existing surgical object.

The forgoing is a summary of various aspects of disclosed embodiments ofthe invention, as well as of the advantages offered by these aspects. Itis not intended to limit the scope of the invention as defined in theappended claims. These and other features and advantages of thedisclosed embodiments are next described in detail, with reference tothe appended drawings, in which:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic illustration of a fluoroscope and programmedcomputer for use in stereotactic measurement of anatomical objects;

FIG. 2 is a schematic representation of a computer;

FIG. 3 illustrates a registration artifact;

FIG. 4 is a flow chart of the basic steps of a method for measuring,using two or more fluoroscopic images, a distance of a line defined bytwo or more points corresponding to anatomical landmarks identified by auser;

FIG. 5 is a sample screen display of the computer in FIG. 1 displayingan anterior/posterior (A/P) image taken by the fluoroscope of FIG. 1 ofa patient;

FIG. 6 is a second sample screen display of the computer in FIG. 1showing in place of the A/P image of FIG. 5 a sagittalsagittal image ofa patient taken by the fluoroscope of FIG. 1;

FIG. 7 is a flow chart of the basic steps of a computer a method for usein determining the fit of a surgical implant in advance of implantationusing two or more fluoroscopic images.

FIG. 8 is a sample screen display from the computer of FIG. 1 showing afirst image of a blood vessel injected with radio opaque dye, taken froma first pose.

FIG. 9 is a sample screen display from the computer of FIG. 1 showing asecond image of the blood vessel, but taken from a second pose and at atime subsequent to the first image, showing progression of the dyewithin the blood vessel.

FIG. 10 is a sample screen display showing a third image taken from thesecond pose, but at a time subsequent to the time at which the secondimage is taken, for purposes of measuring the distance dye within theblood vessel has moved and calculating a velocity based on the intervalbetween the times the second and third images where taken.

DETAILED DESCRIPTION OF DRAWINGS

In the following description, like reference numbers refer to likeparts.

Referring to FIG. 1, C-arm type fluoroscope 10 generates fluoroscopic orx-ray images of a body on a surgical table 12. Imaging arm 14 of thefluoroscope 10 can be slid on its mounting base so that it can berotated around the table to enable images to be taken from differentangles and thereby obtain different poses. The C-arm fluoroscope is arepresentative example of fluoroscopes typically used in hospitaloperating rooms. The invention can be used, however, with other types offluoroscopes. A fluoroscope illuminates a target body withelectromagnetic radiation at X-ray wavelengths and sensing or recordingthe resulting shadow using a camera or film sensitive to the radiation.The fluoroscope can be used for either intermittent image capture orcontinuous video. However, continuous fluoroscopy during a surgicalprocedure is undesirable because it exposes the surgeon and patient toexcessive radiation. Thus, typically, fluoroscopic images are taken of apatient immediately before or during surgery to assist the surgeon inplanning the operation. As exemplified by the C-arm fluoroscope 10, afluoroscope is easily positioned in any number of arbitrary positionsaround the patient as compared to other types of medical imagingequipment. Furthermore, as compared to more advanced forms of imagingsuch as computed tomography (CT), fluoroscopy is relatively inexpensive.

Referring briefly to FIG. 1 and FIG. 2, computer 20 is a device, such asa programmable workstation or desktop computer, capable of executingcertain processes described below in connection with FIGS. 4-9.Programmable desktop computers suitable for executing the processesinclude personal computers, networked workstations and graphicalworkstations. FIG. 2 is a schematic representation of basic functionalcomponents typically found in a programmable, general-purpose computer.The computer is coupled to fluoroscope 10 for receiving fluoroscopicimages through an image acquisition card 22. The computer includes amicroprocessor 24 for running software instructions, random accessmemory (RAM) 26 for temporarily storing software instructions and dataduring execution of programs, and a hard disk drive 28 for non-volatilestorage of data, program and other types of files. Computer 20 is alsocoupled to at least one graphics monitor 30. The graphics monitor 30 isused to display fluoroscopic images as well as to provide a userinterface for the exchange of information and commands between processesrunning on the computer and the user. Two monitors are actually shown inFIG. 1: monitor 30 a displays an A/P image and monitor 30 b displayssagittal image. However, a single monitor can be used to display two ormore images in multiple windows or by switching between the images. Thefollowing description will be in reference to a computer with a singlemonitor 30 (FIG. 2). Computer 20 is also coupled to a user input device32. In the illustration, the input device includes several components: akeyboard 34 for entering typed commands and information; and a trackball or mouse 36 for moving a cursor or pointer on the monitor. Thevarious components within the computer communicate with each other overa bus structure, which is conceptually represented by bus 38.

Referring now to FIGS. 1 and 3, fluoroscopic images taken from differentposes or angles must be registered to a common three-dimensional frameor coordinate system, in which the patient is in a fixed position.Registration involves determining a correspondence between eachfluoroscopic image and the workspace in which the patient lies. Severalmethods can be used to register the images. Typically, registration hasbeen derived from positioning of the fluoroscope. However, the preferredregistration method is described in U.S. Pat. No. 5,799,055 of Peshkinand Santos-Munné, which is incorporated herein by reference for allpurposes. According to this method, a registration artifact 40 that isheld in a fixed position relative to the patient while one or morefluoroscopic images are acquired from different angles or “poses” usingfluoroscope 10. The registration artifact is positioned using a flexiblearm 42 situated adjacent the surgical table 12. Flexible arm 42 includesa flexible arm assembly 44 having an end flange 46. The registrationartifact 40 is coupled to the end flange 46. The flexible arm 42 canadjust the position of artifact 40 in three-dimensions.

The Peshkin—Santos-Munné registration method does not depend onknowledge of the positioning of the fluoroscope. Rather registration isdetermined from the fluoroscopic images. The registration artifact 40 isX-ray transparent with the exception of a plurality of radio-opaquespheres or fiducials 48. In the illustrated artifact there are eightfiducials. The fiducials 48 are easily identifiable on a fluoroscopicimage. The positions of these fiducials relative to a three-dimensionalcoordinate system are fixed by the artifact, and are known either bydesign or by measurement. The artifact is shaped so that none of thefiducials will cast a shadow, or block, any of the other fiducials whenroughly orthogonal images are taken. From the two-dimensional locationsof the projections of these fiducials in a fluoroscopic image, which aresmall, well-defined dots, geometric projections that carry athree-dimensional point anywhere in the vicinity of the artifact into aprojected point on the image can be determined. This establishesregistration between image and workspace. Several images can each beregistered relative to the same registration artifact, thus alsobringing all the images into registry with one another. The methoddisclosed by Peshkin and Santos-Munné thus enables the determination ofprojective geometric relationships that relate each of two or moreacquired fluoroscopic images to the three-dimensional workspace aroundand within the patient's body, despite essentially arbitrary positioningof the fluoroscope. There is no requirement that the poses beorthogonal, nor is there a need to instrument the fluoroscope so thatthe pose angles can be measured.

According to the registration method described in detail in U.S. Pat.No. 5,799,055, the two-dimensional coordinates of the fiducials withinan image are determined. The image is then registered by projecting theknown three-dimensional coordinates of the fiducials into thetwo-dimensional image points of the fiducials according to apredetermined geometric model, and then numerically optimizing theparameters of the geometric model such that the projections of the knownthree-dimensional coordinates of the fiducials best fit the identifiedtwo-dimensional coordinates in the image. This method is repeated forall images taken of the patient's body and the registration artifact butfrom an angle different from that of the first image. Thus, atransformation and its inverse are obtained for mapping between a pointdefined within the two-dimensional image to a line in thethree-dimensional coordinate system. A mathematical description of thenumerical optimization of the model and the mapping can be found in theAppendix to U.S. Pat. No. 5,799,055.

Referring now to FIG. 4, illustrated is a method 100 for measuring ananatomical feature using the system of FIG. 1 by specifying two or moreanatomical landmarks. The method will be described in reference to FIG.1, as well as to FIGS. 5 and 6. At step 102, a user, such as doctor,nurse or technician, acquires two or more fluoroscopic images fromdifferent angles or poses of a portion of a patient lying on table 12(FIG. 1). For example, for purposes of this description, the acquiredimages are taken from an anterior/posterior (A/P) pose and a sagittalpose. The images are displayed on monitors 30 a and 30 b, respectively.The images are then registered at step 104 to a known three-dimensionalcoordinate system in which the patient is located. Alternately, oneimage at a time can be acquired and registered. In this case, steps 102and 104 would be repeated for each image.

As previously stated, the registration method of U.S. Pat. No. 5,799,055is the preferred method of registration. Other methods could be used,but without the benefits of this method. FIG. 5 illustrates theappearance of a screen 200 of the monitor when displaying an A/P image202. For purposes of clarity, outlines of anatomical features have beenleft out of the image. The image contains a plurality of dots 204 thatare shadows of fiducials 48 of the registration artifact 40 (FIG. 3).Similarly, screen 300 of FIG. 6 displays the sagittal image 302containing a plurality of dots 304 that are shadows of the samefiducials. For accurate registration, all of the fiducials 48 in theregistration artifact 40 should appear in each image. If not, theartifact 40 or the imaging arm 14 is adjusted so that all eightfiducials appear.

To register an image, the location of each fiducial's shadow within animage is identified. This location is specified using a two-dimensionalcoordinate referenced to the image. This can be done by the userpointing to the shadow with a cursor or other pointing device, or by thecomputer intelligently determining fiducials' shadows by their shape andrelative positions using a pattern recognition algorithm. Once thelocations of the shadows of all the fiducials are identified within animage, the computer registers the image through methods described inU.S. Pat. No. 5,799,055. In connection with the registration, thecomputer will account for distortion in the images caused by thefluoroscope's image intensifier, as described in U.S. Pat. No.5,799,055. For example, such distortion will cause a straight line inthe three-dimensional workspace of the patient to appear curved in theimage. To account for this distortion, the computer may correct thedistortion in the displayed images. Alternately, to avoid the processingassociated with correcting each image, the computer may correct for thedistortion when mapping between a two-dimensional coordinate point in anuncorrected image and the three-dimensional coordinate system. Althoughnot necessary for the method of FIG. 4, or the method of FIG. 7 to bediscussed next, correcting the images is advantageous, especially forthe method of FIG. 7 and FIG. 8. The images 202 and 302 of FIG. 5 arecorrected.

Once the images have been registered, the process of FIG. 4 continues atstep 106 with the user specifying to the computer the location withinone of the two images, in the case the A/P image 202 (FIG. 5), two ormore points corresponding, respectively, to two or more anatomicallandmarks. If a distance between two anatomical landmarks is desired,only two points need to be specified. For example, should a surgeondesire to know the precise diameter of a tumor at a particular location,points on diametrically opposite sides of the tumor are specified.Should a user be seeking the length of a curved or non-linear surface orother anatomical feature, several points can be specified along itslength. For example, should a surgeon desire to determine the length ofan artery that is not straight, the centerline of the artery can bespecified with a plurality of points spaced along its length thatapproximates it.

For purposes of this description, a user has specified two points,represented graphically by points 206 and 208 drawn on the A/P image 202of FIG. 5, by positioning a cursor or using some other type of pointingmechanism device to identify two anatomical landmarks and signaling thecomputer (e.g. by clicking a mouse button) to accept the coordinates ofthe pointing mechanism as specifying the points to be used in measuringan anatomical distance or dimension. The computer then draws or displayswithin the image 202 on the computer screen a dot superimposed on eachanatomical landmark specified by the user. By specifying these twopoints in the A/P image, the user has specified, in effect, a line ofsight within the three-dimensional space of the patient that can beuniquely identified within the three-dimensional coordinate system towhich the image has been registered. This line of sight is determined bythe transformation mentioned above that maps each point within thetwo-dimensional image to the three-dimensional coordinate system.

Proceeding to steps 108 and 110 of FIG. 4, to reduce each line of sightto a point in the three-dimensional workspace of the patient, the userspecifies to the computer the positions of the anatomical landmarks inthe other image, in this example the sagittal image 302 of FIG. 5. Thecomputer, however, constrains the user to specifying or selecting pointsthat lie along each line of sight. To assist the user, the lines ofsight for the points specified on the A/P image 202 are represented bylines 306 drawn by the computer on the image 302. Furthermore, ifdesired, the computer may specify within the three-dimensionalcoordinate system default locations of the points and draw correspondingprojections as dots 308 and 310. Once the dots are displayed, the useris able to slide them, using a mouse or other pointing device, along thelines as indicated by arrows 312 until they align with the respectiveanatomical landmarks.

At step 112 of FIG. 4, once two points in the three-dimensionalworkspace are defined, the computer calculates the straight linedistance between them and provides it for use by the user, such as onthe computer screen 200 or to some other device. Should more than twopoints be specified, the computer best fits, using well knowntechniques, a curve to the points that terminates at the points mostdistant from each other. If desired, the user could specify the type ofcurve. The length of the curve is then calculated, and the resultprovided to the user or other device.

Referring now to only FIG. 5, the screen 200 preferably includes agraphical user interface. The graphical user interface features softwarebuttons, and/or drop-down menus, that can be pushed to change the modeof operation or to perform some predefined function or process.Preferably, the buttons are located on the screen outside the area inwhich the fluoroscopic images are displayed. The menus and buttons canbe made context sensitive. For example, in FIG. 5, selecting button 210signals the computer to commence the process of acquiring an A/P imagefrom the fluoroscope, button 212 starts a process for selecting oridentifying the fiducials within the image for registration, and button214 starts a process for calculating the registration of the image to athree-dimensional coordinate system. Selecting button 314 starts theprocess of acquiring a sagittal image, button 316 starts the process ofidentifying the fiducials and button 318 starts the process ofcalculating the registration of the image. FIG. 5 also includes a button320 for initiating the measurement process of step 112 (FIG. 4) betweenthe specified points and a display area 322 for displaying the resultingmeasurement. Also illustrated are two buttons whose use will bedescribed in connection with an alternate process for determining anappropriate size or shape for an implant illustrated by FIGS. 6 and 7:button 324 starts a process for loading a predefined virtual surgicalobject and button 326 starts a process for providing, by display orotherwise, parameters of the virtual surgical object.

Referring now to FIGS. 6 and 7, method 400 of FIG. 6 describes acomputer-aided process by which fluoroscopic images may be used toassist with selecting or defining a size and shape of a surgical objectto be implanted in a patient. This process can be used in conjunctionwith, or as an alternate to, the method 100 described in connection withFIGS. 4 and 5. For example, method 100 (FIG. 4) can be used to make aninitial selection of an implant, and the method 400 used to test and/orrefine the selection.

Process 400 starts with steps 402, 403 and 404, in which two or,optionally, more fluoroscopic images are acquired and registered to acommon three-dimensional coordinate system. These steps aresubstantially the same as steps 102, 103 and 104 of FIG. 4. FIG. 7 is anillustration of a screen 500 generated by computer 20 (FIG. 1). Itdisplays an A/P image 502 and sagittal image 602 acquired during step402. The A/P image includes a picture of an artery 504 of a patienttaken from an A/P pose. Dots 506 correspond to the fiducials 48 in theregistration artifact 40. The sagittal image includes a picture of theartery 504 in a sagittal pose. Dots 604 correspond to the fiducials inregistration artifact 40.

At step 406, a user specifies to the computer by reference to either ofthe images, but in this example, to image 502, the location of a virtualsurgical object or implant model. A virtual surgical object is athree-dimensional model of an object to be implanted into a patient. Themodel is defined within the three-dimensional coordinate system to whichthe images are registered. In this example, a user specifies a point inimage 502, and then switches to image 602 to designate a point along theline of sight defined by the selection of the point on image 502 atwhich the virtual surgical object will be loaded. This then defines apoint in the three-dimensional coordinate system at which a virtualsurgical object will be located, the coordinates for which the computerdetermines at step 408. These steps are not illustrated by FIG. 7.

At step 410 of process 400 (FIG. 6), the user pushes button 324 to loada predefined virtual surgical object at the designated point. Thecomputer then draws on the images 502 and 602 a two-dimensionalgraphical representation of the virtual surgical object projected ontothe images according to the predetermined geometrical model with whichthe images have been registered to the three-dimensional coordinatesystem or workspace. This graphical representation will be referred toas a projected surgical object. In the illustrated example, the surgicalobject is a stent that will be inserted into artery 504. Thethree-dimensional model of the stent that serves as the virtual surgicalobject in this example is a tube having a length and outer diameter thatcan be specified by the user or be set to correspond to a stent of somestandard size. In FIG. 7 the projected surgical object is projectedstent 508, and in FIG. 9 it is projected stent 606. The illustrationsshow both projected stents to be within artery 504. However, a surgeonmay want to test different sizes and/or shapes to determine the mostappropriate stent for implanting in the patient.

At step 412, in order to determine the best fit of a surgical objectwith the anatomy of a patient, the user can manipulate or alter thegraphical features of either projected surgical objects in order tochange the size, shape or orientation of the virtual surgical object.The user manipulates the projected surgical object with a pointingdevice or by entering some numerical value indicating a change in theprojected surgical object. The computer then, in response to thismanipulation, recalculates the position, size and/or orientation of thevirtual surgical object and updates at step 414 the projected surgicalobjects on each image so that they remain accurate projections of thevirtual surgical object. Alternately, or in addition to the manipulationof the projected surgical object, the user may manipulate the virtualsurgical object by entering directly a change in one or more of theparameters of the model for the virtual surgical object. The projectedsurgical objects on the fluoroscopic images 502 and 602 are thusconstrained by the virtual surgical object: a change in one of theprojected surgical objects results in change in the other projectedsurgical objects. Once the user is satisfied with the fit, the computerprovides the parameters of the model to the user or to some other deviceif desired. In the disclosed embodiment, a software button 326 (FIG. 7)is provided to cause the computer to provide or display on the screenthe parameters of the virtual surgical object 328 (FIG. 7). With theseparameters, an appropriate surgical object or implant may be fabricatedor, alternately, selected and, if necessary, modified for insertion.

In the illustrated example, the outline of the exterior surfaces of thevirtual stent can be manipulated by the user stretching the apparentdiameter of projected stent 508, as indicated by arrow 510 and arrow 608in FIG. 7, or its length, as indicated by arrow 512 and arrow 610 inFIG. 7. To stretch the projected stents, the user manipulates, inpreferred embodiment, the projected stents with a pointing device, suchas a mouse or trackball that controls a position of a cursor. A pointingdevice is more intuitive for a user when trying to obtain the best fitbetween a projected surgical object and an anatomical feature. Othertypes of pointing devices could be used, such as a touch screen.However, numerical values can be entered instead to specify the amountof stretch.

More complex models of a virtual surgical object could allow forreshaping, bending or other manipulation, such as might be done to alterthe object prior to, or during, implantation. These models could,furthermore, be programmed to alert the surgeon as to possible failuresdue to the manipulation or limit the user to permitted alterations. Forexample, in the case of stent, the model may allow the tubular-shapedstent to be bent to conform to the shape of an artery, such as might bedone during surgery. However, bending the stent too far may cause thewall of the stent to collapse or kink, thereby reducing thecross-sectional flow area of the stent and thereby defeating itspurpose. The model could therefore either warn of problem with amessage, refuse to be manipulated in the fashion desired by the user, orsimply illustrate the resulting problem—the kink in the forgoingexample.

Referring now to FIGS. 8, 9 and 10, the velocity of objects aremeasurable using registered fluoroscopic images and the techniquespreviously described for measuring distances. For example, the velocitywith which radio-opaque dye flows through a blood vessel can bedetermined by marking the positions of the dye in two images taken atdifferent times, calculating the distance between the marked positions,and calculating the velocity based on the time interval between the twoimages using the well known formula of the distance divided by thechange in time. With the velocity, an estimate of the volumetric bloodflow rate based on measured or a prior knowledge of the diameter of theblood vessel can be made. Two different approaches can be taken tomeasuring the distance of a moving object. In the first method, imagesare captured from the fluoroscope in at least two different poses andregistered to a common coordinate system in order to provide thecapability of specifying a point in three-dimensional space in each of aset of two-dimensional images taken of a simple pose. In the secondapproach, where the blood vessel, and thus the trajectory of the movingobject, is relatively straight and lies within the plane of the image,such that there is no foreshortening, the images can be taken from onlyone pose. In each method, the computer can capture images from thefluoroscope at regular intervals, typically up to as many as thirtytimes a second, such that the time intervals between the images isknown.

FIG. 8 is used only in connection with the first method. In FIG. 8, afirst image 802 is acquired of the blood vessel 803 in a first pose.Radio-opaque dye 801 is seen transversing the blood vessel. The image,which is shown in screen 800, is registered to a known coordinate frame.In the illustrated example, artifact 40 (FIG. 3) is positioned in thefield of view of the fluoroscope, resulting in the appearance of dots804 representing the shadow of fiducials 44. The positions of theshadows are used to register the image to a known coordinate frame inthe manner previously described.

In FIG. 9, the fluoroscope has been repositioned in order to captureimages of the blood vessel in a second pose. Screen 900 displays asecond image 902, which has been taken at a time subsequent to the firstimage 802 (FIG. 8). Dots 904, which are projections of the fiducials 44of artifact 40 (FIG. 3), are used to register image 902 to the knowncoordinate frame in the manner previously described. Once theregistration transform is obtained, it can be used to register all otherimages taken of this second pose. The position of the crest of theboundary of radio-opaque dye 801 within blood vessel 803 is marked withdot 906. This dot defines a line of sight in image 802 of FIG. 8. Thisline of sight is indicated by dashed line 806 in first image 802.Because the first and second images are now registered, thethree-dimensional position of the crest of the dye is specified bymarking with dot 808 where, along the line of sight 806 in the firstimage 802, the middle of the blood vessel is located. Dot 808 and dot906 are thus constrained to the same three-dimensional point. Also,although not shown, lines approximately identifying the axis of thevessel can be drawn on the first and second images so that the positionof the boundary of the dye can always be taken with respect to thecenter of the vessel.

A third image 1002, displayed in screen 1000 of FIG. 10, is taken at asubsequent time, such that the time interval between the second andthird images is known. The position of the crest of the dye boundary ismarked by dot 1004. Dot 1004 defines a line of sight in first image 802of FIG. 8, which is represented by dashed line 810. The point at whichthe line of sight intersects with the middle of the blood vessel ismarked with dot 812. Dots 812 and 1004 are therefore constrained to asingle point in the three-dimensional coordinate system to which theimages 802, 902 and 1002 are registered.

In response to activation of button 320, the computer then calculatesdistance between the marked positions of the dye. This distance isrepresented by line 1006. The result is provided in output field 322.Additional images can be taken to show the progression of the dye, withthe position of the dye in each image indicated. Since the time eachimage was captured, relative to the other, is known, the velocity of thedye can be determined. Because the velocity of the dye is approximatelythe same as its carrier, the velocity of the blood flow is thus alsoknown.

Furthermore, as indicated by dialog box 910, the computer, using wellknown equations, can estimate the volume of the blood vessel using thediameter and the velocity. The diameter of the blood vessel can bemeasured, in the manner previously described, or using estimate of thediameter that is already known. Activating button 908 causes the flowrate to be calculated and displayed in the dialog box 910. Activatingbutton 912 causes the dialog box to be displayed. Although notillustrated, successive position measurements of the dye boundary,combined with the time intervals with which they were made, permitscalculation of the acceleration of the blood flow velocity and rates.

In the second method, if the observed portion of the trajectory of theobserved object is fairly straight and generally falls within the planeof the image, velocity along the path of movement of the object beingmeasured can be determined using multiple images taken only of a singlepose. A second position, which would otherwise be used to constrain thespecification of the position to dye boundary in images taken from thefirst position, may not be necessary in this situation, especially ifthe scale of the image can be determined from a feature shown in theimage. This second method is the same as described in connection withFIGS. 9 and 10, except that an image from a second position of thefluoroscope is not used. A priori knowledge of the dimension of ananatomical feature or other object within or close to the plane of thetrajectory of the object, for example that defined by the blood vessel,permits deduction of a scale with which to determine actual distances.For example, knowledge of the actual physical dimensions of a stent thathas been previously placed in the blood vessel, or of the typicaldiameter or length of the blood vessel being observed, can be used tocreate the scale with which to measure distances. Once the scale isspecified, the computer can be used to determine actual distances basedon marking the progress of the dye or other object. This second methodwill likely be less precise than the first method described above, andits usefulness is limited to particular situations.

As mentioned, both methods can also be adapted to be used to measurevelocities and accelerations of other objects visible in fluoroscopicimages, as well as to determine acceleration of an object.

Furthermore, certain methods and apparatus described above in connectionwith FIGS. 1-10 could be adapted to be used with or applied to othertypes of two-dimensional images, although they have particular advantagewhen used with fluoroscopic images.

The invention has been described in detail with reference to a certainpreferred embodiments. Modifications may be made to the disclosedembodiments without departing from the scope of the invention as definedby the following claims.

1. A computer based method for determining a correct size or shape of asurgical implant to be implanted in a patient, comprising: displaying afirst fluoroscopic image taken of an anatomical feature from a firstangle, the first fluoroscopic image being registered to a commonthree-dimensional coordinate system; receiving an indication of positionwithin the first fluoroscopic image of a three-dimensional virtualsurgical implant, the three-dimensional virtual surgical implant beingdefined with reference to the common three-dimensional coordinate systemand having one or more attributes corresponding to one or more physicalcharacteristics of the surgical implant to be implanted in the patient;displaying a second fluoroscopic image taken of the anatomical featurefrom a second angle, the second fluoroscopic image being registered tothe common three-dimensional coordinate system; computer generating onthe first and second fluoroscopic images two dimensional projections ofthe three-dimensional virtual surgical implant and updating the twodimensional projections of the three-dimensional virtual surgicalimplant in the first fluoroscopic image in response to a usermanipulating the two-dimensional projections of the three-dimensionalvirtual surgical implant in the second fluoroscopic image.
 2. Thecomputer based method of claim 1 wherein manipulating thetwo-dimensional projections of the three-dimensional virtual surgicalimplant includes moving the two-dimensional projection to a positionwhere it best aligns with an anatomical feature as shown in the firstfluoroscopic image.
 3. The computer based method of claim 1 whereinmanipulating the two-dimensional projections of the three-dimensionalvirtual surgical implant includes modifying a dimension of the virtualsurgical implant to align the two-dimensional projections with ananatomical feature as shown in the first fluoroscopic image.
 4. Thecomputer based method of claim 1 wherein the three-dimensional virtualsurgical implant represents a stent and manipulating the two-dimensionalprojections of the three-dimensional virtual surgical implant includesmoving the projection of the virtual surgical implant to a positionwhere the two-dimensional projections in the first and secondfluoroscopic images overlay an artery into which a stent will beimplanted.
 5. A computer readable storage medium on which is recordedprogram instructions that, when read and executed by a computer, causethe computer to undertake the following steps: displaying a firstfluoroscopic image taken of an anatomical feature from a first angle,the first fluoroscopic image being registered to a commonthree-dimensional coordinate system; receiving an indication of positionwithin the first fluoroscopic image of a three-dimensional virtualsurgical implant, the three-dimensional virtual surgical implant beingdefined with reference to the common three-dimensional coordinate systemand having one or more attributes corresponding to one or more physicalcharacteristics of the surgical implant to be implanted in a patient;displaying a second fluoroscopic image taken of the anatomical featurefrom a second angle, the second fluoroscopic image being registered tothe common three-dimensional coordinate system; computer generating onthe first and second fluoroscopic images two dimensional projections ofthe three-dimensional virtual surgical implant: and updating thetwo-dimensional projections of the three-dimensional virtual surgicalimplant in the first fluoroscopic image in response to a usermanipulating the two-dimensional projections of the three-dimensionalvirtual surgical implant in the second fluoroscopic image.
 6. A computerbased method for planning a size and shape of a surgical object forimplementation in a patient, comprising: generating a first fluoroscopicimage of an anatomical region taken from a first direction; generating asecond fluoroscopic image of the anatomical region taken from a seconddirection; registering the first and second fluoroscopic images to acommon three-dimensional coordinate system; displaying the first andsecond fluoroscopic images; defining a three-dimensional virtualsurgical implant in the common three-dimensional coordinate system;projecting first and second two-dimensional projections of thethree-dimensional virtual surgical implant onto the first and secondfluoroscopic images along the first and second directions, respectively;moving the first and second two-dimensional projections of thethree-dimensional virtual surgical implant to align thethree-dimensional virtual surgical implant to a common anatomicalstructure displayed in the first and second fluoroscopic images.
 7. Themethod of claim 6, wherein moving the first and second two-dimensionalprojections of the three-dimensional virtual surgical implant includes:translating and rotating the first and second two-dimensionalprojections of the three-dimensional virtual surgical implant withinplanes of the first and second fluoroscopic images to translate androtate the three-dimensional surgical implant in three dimensions. 8.The computer based method of claim 6, further including: resizing thethree-dimensional virtual surgical implant.
 9. The computer based methodof claim 8, wherein resizing the three-dimensional virtual surgicalimplant includes one of: replacing the three-dimensional virtualsurgical implant with another three-dimensional virtual surgical implantof a different size; and, scaling the three-dimensional virtual surgicalimplant in one or more dimensions.
 10. The computer based method ofclaim 6, further including: adjusting at least one dimension of thethree-dimensional virtual surgical implant to fit the three-dimensionalvirtual surgical implant to the common anatomical structure.
 11. Acomputer readable storage medium on which is recorded programinstructions that, when read and executed by a computer, cause thecomputer to undertake the steps of claim
 6. 12. A surgical planningsystem comprising: a fluoroscopic imaging device; at least one monitorfor displaying the fluoroscopic images; and a computer programmed toperform the method of claim
 6. 13. The computer based method of claim 6wherein the virtual surgical implant represents a surgical implant andfurther including: selecting the virtual surgical implant from adatabase storing a plurality of virtual surgical implants representingdifferent or differently sized implants.
 14. A surgical planning systemcomprising: a fluoroscopic imaging device for generating a firstfluoroscopic image of an anatomical region taken from a first directionand a second fluoroscopic image of the anatomical region taken from asecond direction; at least one video monitor for displaying at least thefirst and second fluoroscopic images; means for registering the firstand second fluoroscopic images to a common three-dimensional coordinatesystem; a computer memory storing a plurality of predefined virtualsurgical implants; a means for positioning a selected one of the virtualsurgical implants in the three-dimensional coordinate system; a meansfor projecting the selected virtual surgical implant along the first andsecond directions onto the first and second fluoroscopic images; aninput device for at least translating and rotating the virtual surgicalimplant to align the virtual surgical implant to a common anatomicalstructure displayed in the first and second fluoroscopic images.
 15. Thesurgical planning system of claim 14, wherein the input device furtherenables the operator to at least one of: replace the selected virtualsurgical implant with another virtual surgical implant from the computermemory; and adjust a size of the selected virtual surgical implant inone or more dimensions.
 16. The surgical planning system of claim 14,wherein the virtual surgical implant depict three dimensional medicalimplant devices.